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Image processing method and system for extracting a string of points following a threadlike 
structure in a sequence of images 



The invention relates to an image processing method and to an image 
processing system for extracting a path following a threadlike structure in a sequence of 
images. The invention further relates to a medical examination apparatus for carrying out said 
method using said system. The invention finds for example its application in the medical 
5 field of cardiology, for guide-wire extraction in X-ray fluoroscopic images or for thin vessel 
extraction in arteriograms. 



A method for extracting threadlike structures is already known from the patent 
1 0 application WO 00/39753 . This document describes an image processing method and an X- 
ray apparatus having processing means for extracting a threadlike structure represented on 
the background in a noisy digital original image, including steps for acquiring said original 
image data and reducting said original image while using a transformation operation so as to 
provide a reduced image, and in said reduced image, steps for selecting the most probable 
1 5 locations of guide-wire points by selecting, at each point, the direction of the guide-wire as 
the best match with one of several predetermined regularly oriented directions, and by 
probing the contrast around and in said selected directions. Then, in the original image, the 
method has steps for probing the contrast around said selected locations, and extracting the 
points that satisfy a contrast condition, connecting the points that also satisfy a connectivity 
20 criterion in the reduced image, and extracting said points as guide-wire points of the original 
image. 



This known method is available for the extraction of guide-wires that were 
25 designed several years ago, or for the extraction of vessels that are not too thin. Now, the 

most recently designed guide-wires are much thinner than the former guide-wires. And now, 
the practitioners are much more demanding about the resolution of very thin vessels. So, this 
method, which processes one image at a time, would present a calculation load actually 
heavy for real time processing of a sequence of images if the steps were to be applied to 
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images requiring still higher sensitivity and selectivity. As a matter of fact, in cardiology, 
medical procedures using catheters deeply rely on the correct visibility of the guide-wire, 
which is a metallic wire introduced in a vessel for guiding the catheter. The guide-wire 
extraction is the detection and the location of the points belonging to said guide-wire in an 
5 arteriogram image. The newly designed type of guide-wires is much more difficult to 

visualize in a noisy fluoroscopic image than the former type of guide-wires. However, it is 
vital for the patient that the practitioner exactly visualizes the guide-wire that is moved in the 
artery. That is the reason why the method and system to extract a guide-wire must be adapted 
to the newly designed guide-wires. Also, for the application of new medical techniques, the 

10 extraction of thin vessels must be improved. An example is in cerebral arteriography. The 
known method is apt to be carried out in real time but it does not meet the requirements due 
to the above described new techniques and technologies. It is not precise enough and robust 
enough to extract such thin threadlike structures. 

It is an object of the invention to propose a method precise and robust to 

1 5 extract threadlike structures according to the requirements of the present techniques and 

technologies. Such a method is claimed in Claim 1. This method is carried out using temporal 
information, which is provided by a sequence of images. It is to be noted that the introduction 
of a guide- wire, or the observation of thin vessels are operations that can take one or several 
hours. These operations are registered by forming sequences of images on which the 

20 practitioner follows the procedures. As these images are noisy, they are processed to extract 
the objects of interest. Regarding guide-wire procedures, the guide-wire is introduced in the 
artery and moved forward at an irregular pace, with episodes of very slow motion or 
immobility alternating with episodes of faster motion. This particular way of moving the 
guide-wire is taken advantage offer processing an image of the past, in a sequence of 

25 images, or a few number of images of the past, besides the image observed at the instant of 
the present, in order to extract precisely and robustly the threadlike structure in said present 
image processed in real time. According to the principle of the invention, temporal 
information is detected in at least one image of the past of the sequence and is used to 
calculate prediction data. Said prediction data is further used for improving the guide-wire 

30 extraction in a subsequent image at the instant of the present. In other terms, the temporal 
information is acquired in a first mode, labeled acquisition mode, and is processed for 
detecting a "silhouette" of a threadlike structure from at least one image of the sequence 
acquired prior to the instant of the present. The "silhouette" is further processed, in a second 
mode, labeled pursuit mode, in order to provide a restrained zone in which the threadlike 
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structure is precisely and robustly extracted in the image of the sequence formed at the 
instant of the present. Besides precision and robustness, the advantage of the method is that 
the processed image is provided in real time using information that is acquired in a time delay 
not necessarily compatible with real time. It is also an object of the invention to propose a 
5 system to carry out said method and a medical examination apparatus using said system. 



The invention is described hereafter in detail in reference to diagrammatic 
figures wherein: 

1 0 FIG. 1 is a functional block diagram of the main steps of the method; 

FIG.2A illustrates the information obtained at one instant of the past, and the 
silhouette derived from said information; FIG.2B illustrates the information obtained at two 
instants of the past, and the silhouette derived from said information; 

FIG. 3 A illustrates the estimation of a constraint formed by the Canal Zone; 
1 5 FIG.3B illustrates the estimation of a constraint formed by the interval of directions; 

FIG.4A illustrates the step of tip evaluation and FIG.4B illustrates the step of 
shape correlation; 

FIG. 5 is a functional block diagram of medical diagnostic imaging system and 
apparatus for carrying out the method. 

20 

The invention relates to a method for extracting a path following a threadlike 
structure represented in a sequence of noisy images. In the example described hereafter, the 
threadlike structure is a guide-wire denoted by GW represented in an arteriogram sequence 
25 formed in fluoroscopy. It is an object of the invention to provide such a method to extract the 
guide-wire points in the form of a string of points, in the case when high resolution and high 
precision is required, by using temporal information. 

Referring to FIG.l, which is a functional block diagram, the method of the 
invention comprises: 

30 a first phase 10, labeled "acquisition mode", which processes an original 

image 1 or 1, 2 of the sequence formed at a first instant; the original image is formed of 
image data including point coordinates and a luminance intensity value for each image point 
denoted by X; in the acquisition mode, at said first instant, a location of the guide- wire in 
said original image is detected; said detected guide-wire is a first string of points; 
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a second phase 20, labeled "prediction mode", which calculates, from the 
location detected during the first phase, a prediction of the location of the guide-wire, labeled 
"silhouette" to be used in a further phase of extraction of the guide-wire; the operation of the 
first and second phases may outlast the time delay imparted for real time processing of an 
5 image in the image sequence, which time depends on the image rate in the sequence; the 
silhouette is a string of points; 

a third phase 30, labeled "pursuit mode", which processes an image 3 of the 
sequence formed at a subsequent second instant, called present instant t, for extracting the 
guide-wire at said present instant t, using the silhouette information, and using a time delay 

1 0 compatible with real time processing; the extracted guide- wire is the best possible string of 
points for representing the guide-wire. 

More generally, the present method is temporal and uses two or several images 
of an image sequence, comprising at least a first image 2, from which the silhouette is 
detected, said first image being formed at a first instant, called instant of the past, and a 

1 5 second image 3, from which the guide-wire is extracted, said second image being formed at a 
second instant called present instant t. In a variant, the silhouette may be detected by 
processing two subsequent images formed at instants of the past, that is anterior to the present 
instant. Setting t as the present instant, the silhouette may be detected from images 1 and 2 of 
the sequence formed at instants t-2 and t-1. These methods present several advantages. They 

20 are more robust a the known method, labeled spatial processing method, which extracts the 
guide- wire using only one image uniquely formed at the present instant, because more 
information is available from the processing of several images including images of the past. 
The calculation time for extracting the guide-wire at the present instant is minimized since 
the location and the kinetics of the guide- wire are already known from the results of the 

25 acquisition and prediction modes. The guide-wire may be extracted very precisely in a very 
short time by processing a limited zone around the predetermined silhouette. 

Referring to FIG.2A, in the acquisition mode 10, it may be chosen to process 
only one sequence image 2 denoted by I t _i formed at the instant t-1, where t is the present 
instant. In this case, only the location of the guide-wire at the instant t-1 is detected. This 

30 location is denoted by G t -i. Referring to FIG.2A, in the prediction mode, the detected location 
G t .i of the guide- wire constitutes the silhouette labeled G t , so that G t = G t .j. Referring to 
FIG.2B, in the acquisition mode 10, preferably, it may be chosen to process two sequence 
images 1, 2, denoted by I t . 2 , I t -i, respectively formed at instants t-2 and t-1, where t is the 
present instant. In this case, the location of the guide-wire at the instant t-2 is denoted by G t . 2 , 
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its location at the instant t-1 is denoted by G t _i. In the acquisition mode, the location(s) G t -2 
and/or G t -i of the guide-wire at the instants t-2, t-1 is (are) detected using a known spatial 
extraction method. 

Referring to FIG.2B, in the prediction mode, the translation value, represented 
by the arrow 5, between the location G t . 2 at t-2 and the location G t .i at t-1 is calculated, which 
permits of calculating the speed of translation of the guide-wire between the instants t-2 and 
t-1, and the translation value, represented by the arrow 6, between the instant t-1 and the 
present instant t. These calculations provide a calculated location of the guide- wire, labeled 
silhouette G t = P(G t ), at the instant t, where P is a prediction function. In the prediction 
mode, the translation values may be calculated using techniques known of those skilled in the 
art, such as a "distance map" technique. 

Referring to FIG. 3 A, in the pursuit mode 30, the silhouette G t is considered 
in the sequence image formed at the instant t, and a process of extraction of the guide-wire G t 
is carried out from said silhouette G t . This pursuit mode comprises a procedure of estimation 
of constraints for performing the extraction operation based on the silhouette G t information. 
This constraint estimation comprises an estimation of a Search-Zone. The resulting constraint 
is labeled Search-Zone Constraint. Preferably, the Search-Zone is a canal-shaped zone, 
labeled Canal Zone, around the silhouette G t . The Canal Zone is defined for example using a 
morphological dilation as illustrated by FIG.3A. The geometrical locus where the silhouette 
G t is the center of discs D K (or spheres) is determined. To this end, for each point K of the 
silhouette G, , a disc D K from Dj to Dn, is defined, centered on said silhouette G t . The discs 
D K have a predetermined radius R t . The union of all the discs D K from Di to D N defines the 
Canal Zone CZt, which is used as a restriction zone to look for the location of the guide-wire 
G t at the instant t. This procedure of calculating the Canal Zone results in that the further step 
of extracting the guide-wire G t in said Canal Zone is more efficient than a procedure without 
such a search zone, and is more robust because less sensitive to false locations, which are 
false extracted points of the finally extracted guide-wire G t . 

The guide-wire extraction in the pursuit mode 30 may be carried out using a 
first technique comprising steps of extraction of a string of points using only the Canal Zone 
data, that is only extracting the guide-wire points when these points are located in the Canal 
Zone. In this first technique, the extraction operation is only submitted to one restriction 
condition called Canal Zone constraint, the Search-Zone being constituted by the Canal Zone 
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CZ t . The guide- wire extraction in the pursuit mode 30 may be carried out using a second 
technique, comprising steps of extraction of a string of points using not only the restriction 
condition constituted by the Canal Zone constraint, but also a restriction condition on the 
directions along which the guide-wire may be looked for, which is called Direction 
5 constraint. The candidate points for the guide-wire extraction are associated to a constrained 
interval of directions denoted by A6. A point is extracted under the condition that a direction 
associated to said point belongs to said direction interval AO defined as explained thereafter. 

Referring to FIG.3B, a point X of the Canal Zone CZ t is considered and an 
associated direction is looked for. Said point X belongs to a set of discs Dk from Dki to Dk2 

1 0 previously defined as having a radius R t and being centered on the silhouette G t . Each of 
these discs D K is first associated to the direction of the silhouette G t estimated at its center. 
In the set of discs, from the first disc D K i including the point X, to the last disc Do including 
the point X, as many directions as the number of discs, are defined. These directions 
constitute a set of directions, forming an interval of directions that is to be considered for 

1 5 estimating the direction associated to said point X. Thus, in the method step illustrated by 
FIG.3B, the direction at point X is to be estimated in the constrained interval of directions A0 
defined at the centers of the discs Dk containing X. Referring to FIG.3C, in a variant, a point 
X of the Canal Zone CZ t is considered and an associated direction is looked for. A disc Dkx 
having a predetermined radius, for example equal to the radii of the previously defined discs 

20 D K , is determined centered on X. This disc D K x intersects the silhouette G t in two points Ki, 
K 2 defining a segment. Each point of this segment of G t is associated to the direction of G t 
estimated at said point. This operation defines as many directions as the number of points of 
this segment of G t . These directions constitute a set of directions forming an interval of 
directions denoted by AG that is to be considered for estimating the direction associated to 

25 said point X. Thus, in the method step illustrated by FIG.3C, the direction at point X is to be 
estimated in the constrained interval of directions AG defined at the points of a segment 
having a length defined by the intersection of a disc Dkx centered at X, with G, . 

In both cases of FIG.3B and 3C, the number of points for determining the 
constrained interval of directions AG is a function of the distance of X to G t . When X is far 

30 from G t , the number of points of G t , which is considered to determine the number of 

directions in the interval AG, is few and thus directions are severely constrained in a small 
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interval. When X is nearer to G t in the Canal Zone, the number of points of G t , which is 
considered to determine the number of directions in the interval A9, is larger and thus the 
number of directions is greater. So, when X is located near to G t , the directions are less 
constrained than when X is farer from G t in the Canal Zone. Other methods of providing a 
5 direction constraint for a point X of the Canal Zone may be used for fulfilling this condition. 

For extracting guide-wire points, ridges are looked for in the Canal Zone and 
preferably along the directions belonging to the constrained interval of directions. A ridge is 
a crest-like structure formed by adjacent points having intensity signals that are maximum in 
a neighborhood, said points having specific dispositions the ones with respect to the others 

1 0 resulting in specific gradient values with respect to orientations. A ridge point shows a low 
intensity gradient in a first determined direction in its neighborhood, and shows an intensity 
gradient that is maximum in a direction perpendicular to said first direction. The more a 
given structure is formed of points verifying this gradient property, the more the ridgeness 
measure of the structure is high. Instead of ridges, troughs can be considered in a negative 

1 5 original image for instance obtained by x-ray imaging. In an x-ray negative image, a guide- 
wire is a dark structure on a lighter background. In this case, the calculations for extracting 
the guide-wire have for an object to extract trough points, which can be determined by 
measures similar to ridgeness calculations. In ridgeness calculations applied to troughs 
determination, the estimation of specific intensity gradients that is required for characterizing 

20 ridges is still valuable for characterizing troughs. So, in the description of the present method, 
these calculations are called "ridgeness" calculations, whether they are applied to ridges or 
troughs in the image. This phase comprises a step of "ridgeness" calculation applied to the 
image formed at the present instant t. This "ridgeness" calculation is performed by applying 
on the points of the image at locations restricted to the Canal Zone, filters known as ridge- 

25 filters, which determine the points of the ridge structures, or of the troughs. Based on the 
condition of constraint formed by the constrained direction interval AG, the ridgeness 
calculation for a given point X of the Canal Zone is limited to the directions of said interval 
A6. So, ridgeness is calculated by this local contrast measurement in said Canal Zone and 
along the directions limited to the directions of said interval AO and the best candidate string 

30 of points having the highest ridgeness is further extracted as guide-wire. 

Referring to FIG.4A, the pursuit mode preferably comprises a step of 
adjustment of the location of the tip T t of the guide-wire. Said step of adjustment includes a 
sub-step of tip evaluation for detecting whether tip adjustment is necessary or not. In order to 
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decide whether the tip found for the detected guide-wire is misplaced resulting in an 
extracted guide-wire that has a missing part or an exceeding part, the shape of the silhouette 
G t is compared to the shape of the point string representing the guide- wire, now labeled G' t 
in this sub-step, found at the instant t, according to a technique called "shape correlation" as 
5 illustrated by FIG.4A. The tip of G t is denoted by f t and the tip of G' t is denoted by T' t . The 
arrow 7 illustrates the translation value between G t and G' t . 

Referring to FIG.4B, an operation of "elastic matching" is performed between 
G t and G' t on a diagram representing a first curve H t corresponding to G t and a second 
curve H' t corresponding to G' t . The first and second curves H t and H' t represent the 

10 directions 9(S) of respectively G t and G' t at each point of respective curvilinear abscissa S 
measured in the referential of the corresponding images of the sequence. In a variant, instead 
of the direction 0, the curvature of G t and G' t may be estimated in function of said 
curvilinear abscissa s. The curves H t and H\ start at a reference point denoted by SP which 
may be a starting point of detection of the point strings. A best matching of curves H t and 

15 H't is then performed and the curvilinear abscissa of the tip f t of G t and the tip T' t of G' t 
are compared. Resulting from the comparison, either the point string G' t is not changed, or it 
is lengthened, or it is shortened. The final tip is denoted by T t . The resulting point string is 
subsequently labeled G t and forms the extracted guide- wire at the present instant t. Said final 
tip of resulting point string G t may be estimated using for example a known matching shape 

20 method such as the generalized Hough transform, which enables to find a shape from a 
known gabarit. The silhouette G t may be used as gabarit for detecting the final tip of the 
resulting point string G t . If the final result is not found satisfying, and iteration illustrated by 
the arrow 4 in FIG. 1 may be performed between the prediction mode 20 and the pursuit mode 
30. 

25 Referring to FIG. 5, a medical examination apparatus 1 50 comprises means for 

acquiring digital image data of a sequence of images, and a digital processing system 120 for 
processing these data according to the processing method described above. The medical 
examination apparatus comprises means for providing image data to the processing system 
120 which has at least one output 106 to provide image data to display and/or storage means 

30 130, 140. The display and storage means may respectively be the screen 140 and the memory 
of a workstation 110. Said storage means may be alternately external storage means. This 
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image processing system 120 may be a suitably programmed computer of the workstation 
130, or a special purpose processor having circuit means such as LUTs, Memories, Filters, 
Logic Operators, that are arranged to perform the functions of the method steps according to 
the invention. The workstation 130 may also comprise a keyboard 131 and a mouse 132. 



